Multiple Access Outerbounds and the 
Inseparability of Parallel Interference Channels 



Abstract — It is known that the capacity of parallel 
(multi-carrier) Gaussian point-to-point, multiple access and 
broadcast channels can be achieved by separate encoding 
for each subchannel (carrier) subject to a power allocation 
across carriers. In this paper we show that such a separa- 
tion does not apply to parallel Gaussian interference chan- 
nels in general. A counter-example is provided in the form 
of a 3 user interference channel where separate encoding 
can only achieve a sum capacity of log(SNR)+o(log(SNR)) 
per carrier while the actual capacity, achieved only by joint- 
encoding across carriers, is 3/21og(SNR)) + o(log(SNR)) 
per carrier. As a byproduct of our analysis, we propose a 
class of multiple-access-outerbounds on the capacity of the 
3 user interference channel. 

I. Introduction 



The study of parallel Gaussian channels is motivated 
by the frequency-selective or time-varying nature of the 
wireless channel. With multi-carrier modulation, (as- 
suming no inter-carrier interference (ICI)) a frequency 
selective channel can be viewed as a set of parallel 
channels with channel coefficients that vary from one 
carrier to another but may be assumed constant (flat- 
fading) over each carrier. Similarly, if inter-symbol- 
interference (ISI) is absent, the time-varying channel 
gives rise to parallel channels whose values are fixed 
during each symbol but vary from one symbol to another. 
In this paper, we will use the terminology of frequency- 
selective channels and multi-carrier modulation to refer 
to parallel Gaussian channels. It is understood that the 
model is equally applicable to the time-varying channel 
as well. 

It is well known that over the parallel Gaussian point- 
to-point channel, coding separately over the individual 
subchannels (carriers) achieves the capacity subject to 
optimal power allocation. Thus the capacity of the par- 
allel Gaussian point-to-point channel is equal to the 
sum of the capacities of the point-to-point Gaussian 
subchannels with corresponding powers chosen through 
the water-filling algorithm. Similarly, it has also been 
shown that separate coding over each carrier is opti- 
mal for parallel Gaussian multiple access (MAC) and 
broadcast (BC) channels [1], [2]. The separability of 
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parallel Gaussian point-to-point, MAC and BC is use- 
ful because it provides a direct connection between 
the single-carrier channel models studied extensively in 
classical information theory and the frequency-selective 
(or time varying) channels that may be more relevant 
in practice. Coding schemes designed for the classical 
(single carrier) models can be applied directly to multi- 
carrier systems subject to a power allocation across 
carriers. A key question that remains open is whether 
such a separation holds for other Gaussian networks, and 
in particular, if separate encoding is optimal for multi- 
carrier interference networks. 

Much work on multi-carrier interference networks 
(e.g. in the context of DSL [3]-[ll]) has focused on 
optimal power allocation across carriers under the as- 
sumption of separate coding over each carrier. For the 
two user parallel interference channel with strong inter- 
ference it is shown in [11] that indeed the sum capacity 
is the sum of the rates that can be achieved by separately 
encoding over each carrier subject to an overall power 
optimization. For the case where more than 2 users 
are present or when the channels are not restricted to 
the strong interference case, since the capacity of even 
the single-carrier interference channel is not known, 
usually the rate optimization is carried out under the 
practically motivated assumption that all interference is 
to be treated as noise. Both centralized and distributed 
algorithms, some of which are based on game-theoretic 
formulations, have been proposed for this "dynamic 
spectrum management" problem and the optimality and 
convergence properties of these algorithms have been 
established under the separate encoding assumption. 

Joint encoding of multiple-carriers has been used 
recently in [12] to characterize the sum capacity per 
carrier, of the K user multi-carrier Gaussian interference 
channel. The sum capacity (per carrier) is found to be 



C*(SNR) = y log(SNR) + o(log(SNR)), 

where SNR represents the signal to noise power ratio. In 
other words, the K user interference channel has K/2 



degrees of freedom^ per orthogonal time and frequency 
dimension. The key to the capacity characterization is 
the idea of interference alignment (see [14] and the ref- 
erences therein) - a construction of signals such that they 
cast overlapping shadows at the receivers where they 
constitute interference while they remain distinghishable 
at the receivers where they are desired. The interference 
alignment constructions proposed in [12] are based on 
joint encoding over multiple frequencies. Due to inter- 
ference alignment, the joint encoding scheme of [12] 
outperforms the dynamic spectrum management schemes 
of [4]-[8] in terms of degrees of freedom 0. However, 
it has not been shown that this joint encoding is nec- 
essary to achieve capacity. Interestingly, another recent 
work in [15] has provided examples where interference 
alignment is achieved over a single-carrier interference 
channel, i.e., with separate encoding. Thus, it remains 
unclear whether the capacity of multi-carrier interference 
channels can be achieved by separate encoding over each 
carrier and a power allocation across carriers. It is this 
open problem that we address in this paper. 

The main result of this paper is that unlike the 
point-to-point, multiple-access and broadcast channels, 
in general separate coding does not suffice to achieve 
the capacity of the interference channel. We establish 
this result by constructing a counterexample - a 3-user 
frequency-selective interference channel where separate 
coding can only achieve a sum rate of log(SNR) + 
o(log(SNR)) per carrier while the capacity is shown to 
be 3/21og(SNR) + o(log(SNR)) per carrier. Thus, par- 
allel interference channels are, in general, inseparable. 

As a byproduct of our analysis we also propose a 
class of outerbounds on the capacity of the 3 user inter- 
ference channel. These outerbounds share the property 
that one receiver (possibly aided by a genie and/or noise 
reduction) is able to decode all messages - so that 
the multiple-access channel capacity to the genie-aided 
receiver becomes an outerbound on the sum capacity of 
the 3 user interference channel. The MAC outerbounds 
can be viewed as a generalization of Carliel's outerbound 
[16] on the 2 user interference channel to the case of 
more than 2 users. These outerbounds play an important 
role in identifying singularity conditions for interference 
channels that do not achieve the K/2 degrees of free- 
dom. However, the bounds are generally loose in the 
degrees of freedom sense and tighter bounds at high 
SNR may be obtained by an application of Carlieal's 
outerbound on each of the 2 user channels contained 
within the K user interference channel. 

'Also known as multiplexing-gain (See [13]) or capacity pre-log. 
2 Interestingly, in both cases interference is treated as noise, so no 
multiuser detection is involved. 




Fig. 1, The 3 user interference channel 

We start with the classical (single-carrier) Gaussian 3 
user interference channel. 

II. The Gaussian 3 User Interference channel 

We study the 3 user (single-carrier) Gaussian interfer- 
ence channel whose input-output relations are described 
as follows 

3 

Y i {n) = ^h id Xj(n) + Z i (n),i = l,2,Z 

3 = 1 

where at the nth symbol, Yi(n) and Zi(n) respectively 
represent the received signal and the noise at the ith 
receiver, and Xj(n) represents the signal transmitted 
by the jth transmitter, h^j represents the channel gain 
between transmitter j and receiver i. All channel gains 
are assumed to be non-zero and known to all the nodes in 
the network. Transmitter i has message Wi for receiver 
i for i = 1,2,3. The noise Zj(n) is a zero-mean additive 
white Gaussian noise (AWGN), assumed independent 
identically distributed (i.i.d.) across users and symbols. 
With the noise power at each receiver normalized to 
unity, the total transmit power can be expressed as 
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< SNR, where N is the length 
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of the codeword. The rate of the zth user is defined as 

_ log(|Wj|) 



ft (SNR) = ^Mipii W here \W t \ is the cardinality of 
the message set corresponding to message Wi. A rate 
vector R(SNR) = (ft (SNR), ft, (SNR), ft (SNR)) is 
said to be achievable if messages Wi,i — 1,2,3, can 
be encoded at rates ft (SNR), i = 1,2,3 so that the 
probability of decoding error can be made arbitrarily 
small by choosing an appropriately large N. The capac- 
ity region C(SNR) represents the set of all achievable 
rate vectors in the network. The sum capacity Cs (SNR) 
of the network is defined as 



C7 S (SNR) 
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The number of degrees of freedom of the network is 
defined as 

C S (SNR) 



(is = lim 

SNR^o 



log(SNR) 



Equivalently, is the total number of degrees of 
freedom of the network if and only if we can write 

C S (SNR) = d s log(SNR) + o(log(SNR)). 

Theorem 1: Consider the 3 user interference channel 
where 

for some k S {1,2, 3}, j ^ k,k ^ i,i ^ j. Then, 
this interference channel has 1 degree of freedom, or 
equivalently, the sum capacity of the interference channel 
may be expressed as 

C* S (SNR) = log(SNR) + o(log(SNR)) 
Proof: 

Achievability is trivial since setting W2 — W3 = cf>, 
we get a point-to-point Gaussian channel whose capacity 
is known to be of the form log(SNR) + o(log(SNR)). 
We show the converse for the special case where k = 
1, i = 2, j — 3. i.e., we consider the case where 



By symmetry, the converse extends to all other cases. 
Consider any achievable coding scheme. Let a genie 
give X\ to receiver 2 (Figure |2a)). Now, receiver 2 can 
cancel the interference from transmitter 1 to obtain Y<z 
which may be written as 

Y2 = h,2,2X2 + ^2,3-^3 + %2 

% = h 2 ,2{X 2 + jX 3 ) + Z 2 (1) 

The dependence on the symbol index n is dropped above 
for convenience. Note that any achievable scheme over 
the original channel is also achievable over this genie- 
aided channel and therefore, the genie does not affect the 
converse argument (See for example [14]). Now, since 
we started with an achievable coding scheme, receiver 1 
can decode Xi reliably and therefore, cancel the effect 
of Xi from Y\ to obtain 

Y\ = h\,2,X2 + h\^Xj, + Z\ 

% = h h2 (X2 + "fX a ) + Z 1 (2) 

Note that receiver 2 is able to decode W2 from Y2. 
Equations (f2]i and (Q]l imply that by reducing the variance 
of Z\ sufficiently, we can ensure that Y2 is a noisy 
version of Y\, Therefore, in a channel with sufficiently 
reduced noise, we can ensure that receiver 1 can decode 
W2 as well. Note that reducing noise can only increase 
the capacity of a channel and therefore the converse 
argument is not affected. Thus, by reducing noise and 
with the aid of a genie (Figure |2f a)), we have ensured 
that any message which can be decoded at receiver 2 



can be decoded at receiver 1 as well. Now, in this 
channel, we can let transmitters 1 and 2 co-operate 
to form a MIMO two user interference channel as in 
Figure|2jb). Again, note that allowing transmitters to co- 
operate cannot reduce capacity. Thus, the MIMO inter- 
ference channel of Figure |2|b) has a capacity region that 
contains the capacity region of the 3 user interference 
channel of Figure [T] Reference [17] has shown that the 
MIMO interference channel of Figure |2fb) has 1 degree 
of freedom meaning that its capacity is of the form 
log(SNR)+o(log(SNR)). Therefore, we have shown that 

C S (SNR) = log(SNR) + o(log(SNR)) 

and the converse argument is complete. ■ 

III. The parallel Gaussian 3 user 

INTERFERENCE CHANNEL 

The parallel Gaussian interference channel consisting 
of M parallel subchannels may be expressed as 

3 

Yi(n) = 5^H i)3 -X i (n) + Z i (n),t = 1,2,3 
i=i 

where, corresponding to the nth symbol 
Yj(n), Zi(n), Xj(n) are M x 1 vectors whose M 
entries represent the signal received at receiver i over 
the M sub-channels, the i.i.d. AWGN experienced by 
receiver i over the M carriers, and the signal transmitted 
by the jth transmitter over the M carriers, respectively. 
Hi j is a M x M diagonal matrix whose mth diagonal 
entry represents the channel gain between transmitter j 
and receiver i corresponding to the mth subchannel. All 
channel gains are assumed to be non-zero and known 
apriori to all nodes. Messages, achievable rates, power 
constraints, capacity and degrees of freedom are defined 
in the usual manner as described in the previous section. 

Let C^™' (SNR) denote the sum capacity of the inter- 
ference channel over the m th carrier and SNR TO denote 
the total transmit power constraint over the m th carrier. 
The main question addressed in this correspondence is 
the following - Can the capacity (per carrier) of the 
parallel interference channel be expressed as the sum of 
the capacities achieved by the constituent interference 
channels over each carrier, i.e., 

1 M 

C S (SNR) = — J]4 ml (SNR m ) (3) 

m— 1 

for some power allocation vector 
(SNRi, SNR 2 , . . . SNRjvj) such that 

M 

SNR ™ < SNR - ( 4 ) 

rn—1 
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Fig. 2. The converse argument of Theorem [T] 



(b) 



The existence of a power vector satisfying the above 
equations would imply that a capacity-optimal scheme 
is to code separately over each carrier with power 
SNR m allocated to the mth carrier. We will use the 
result of Theorem [T] to construct a parallel interference 
channel where independent coding over its subchannels 
is suboptimal. Specifically, we construct a multi-carrier 
interference channel where, 

1) Interference alignment achieves 3/2 degrees of 
freedom so that the capacity of the channel is 
3/21og(SNR)) + o(log(SNR)) per carrier. 

2) Each subchannel has only 1 degree of freedom 
meaning that separate encoding over each carrier 
is suboptimal since it can only achieve a capacity 
of log(SNR) + o(log(SNR)) per carrier. 

This is easily done as follows. Consider the case where 
we have 2 carriers, so M = 2. Let 
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.Vt^j.t.jG {1,2,3} (5) 
(6) 
(7) 
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It can be easily verified that each subchannel in this 
above channel satisfies the conditions of Theorem Q] 
so that each subchannel has 1 degree of freedom. Fur- 
thermore, it can also be verified that by beamforming 
messages along vector [1 1] T at each user ensures that 
at all receivers, interference aligns along [1 1] T . The 
desired messages can be decoded along the zero-forcing 
vector [1 — 1] T at each receiver and thus 3/2 degrees of 
freedom are achievable over this network. We now state 
this result formally in a theorem. 
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Fig. 3. A comparison of the performance of joint coding versus 
separate coding on the parallel 3 user interference channel 



Theorem 2: Parallel Gaussian interference channels 
are in general, not separable. Equivalently, in general 
there do not exist coding schemes such that 



M 

C S (SNR) = ^E C i 

ni—1 



(SNR.,, 



M 

SNR m < SNR 

The above theorem clearly implies the sub-optimality 
of separate coding over each carrier of the 3 user 
interference channel in general. 

Figure [3] illustrates the suboptimality of separate cod- 
ing over each carrier in comparison with the interference 
alignment based joint coding scheme for the channel 



described in equations ©-(O. The outerbound for the 
rate achievable by separate encoding (plotted in Figure 
[3]) is derived later in Section [IV] (See example 1 in 
the referred section). Note that in Figure [3] the separate 
encoding outerbound is not limited to schemes that treat 
interference as noise. The outerbound is for the sum of 
the Shannon capacities of the interference channels over 
each carrier, and thus allows arbitrary encoding/decoding 
schemes, possibly including multi-user detection, with 
the only restriction that independent data is sent through 
separate codebooks over separate carriers. Thus, separate 
encoding schemes that treat interference as noise may 
perform much worse than the separate encoding outer- 
bound. The joint encoding achievable rate in Figure [3] 
on the other hand, is based on treating interference as 
noise and is only an innerbound on the rates achiev- 
able with joint encoding. Thus, even the simple joint 
encoding scheme which uses Gaussian codebooks (not 
known to be optimal) and treats interference as noise 
is able to achieve higher rates than could be achieved 
with the best separate encoding schemes. Further, while 
our counterexample is based on a degrees of freedom 
argument which is meaningful only at high SNR, the plot 
in Figure [3] shows that the capacity with joint encoding 
can be substantially higher than with separate encoding 
even at moderate to low SNRs. Lastly, note that no such 
example can be constructed for the parallel Gaussian 
point to point, multiple access and broadcast channels 
because in all those cases separate coding over each 
carrier is capacity-optimal for any channel realization. 

An interesting interpretation of the counterexample 
presented above is the following. Consider a game that 
is played between two players. The players will pick the 
channel coefficient values for a (single-carrier) 3 user 
interference channel. Player 1 intends to maximize the 
number of degrees of freedom of the channel. Player 2 
wants to minimize the number of degrees of freedom of 
the channel. In this game, player 1 moves first and player 

2 moves second. During his turn, player 1 is allowed to 
select the values of all the channel coefficients. Player 2 
can only change the value of 1 channel coefficient after 
the values have been chosen by player 1, Which channel 
coefficient player 2 is allowed to change is also decided 
by player 1. There is a constraint that all channel co- 
efficients (diagonal terms of the channel matrix) must 
be non-zero. First, consider the constant interference 
channel. Note that [15] has already shown that there exist 

3 user channels with close to 3/2 degrees of freedom. 
Therefore, in absence of player 2, player 1 can design 
a channel that will achieve close to 3/2 degrees of 
freedom. However, if player 2 can control any one of the 
channel co-efficients, he can use the result of Theorem 




Fig. 4. Multiple access outerbound for the classical 3 user interference 
channel 

[T]to win the game by reducing the number of degrees of 
freedom to unity. For example, if player 2 has control of 
hi t 2, he can choose the channel co-efficient to be equal 
to hl ^ 2 ' 2 t0 ensure mat * ne channel has only 1 degree 
of freedom. Thus, in a constant single-carrier channel, 
player 2 wins the game. 

Now, suppose the channel coefficients vary with time, 
i.e., we have a parallel Gaussian channel. At each time 
instant the players take turns to design the channel 
coefficients according to the rules described above. Cor- 
responding to each sub-channel, player 2 has control 
of one of the channel co-efficients. In this case, player 
2 can kill the degrees of freedom of the individual 
subchannels by using Theorem Q] However, player 1 
still wins the game since 3/2 degrees of freedom are 
achievable through the interference alignment scheme of 
[12] which codes across all parallel channels. Thus, in 
the time-varying case, player 1 wins the game. 

Note that, it is important that user 2 has control of dif- 
ferent channel co-efficients over different sub-channels. 
If user 2 controls the same channel co-efficient of all 
the subchannels, it can, in fact, use Theorem Q] to kill 
the degrees of freedom of the channel. For example, 
consider the case where if user 2 has control of all the 
entries of Hi 2 over all subchannels, then it can choose 

Hi, 2 = H li3 H2,2(H2 ! 3) _1 . 

IV. Multiple access outerbounds for the 

CAPACITY OF 3 USER INTERFERENCE CHANNEL 

In this section, we provide an interesting application 
of the result of Theorem Q] in the form of a class 
of outerbounds for the classical (single-carrier) 3 user 
interference channel. The outerbound argument goes as 
follows. Consider any achievable coding scheme. Using 
this coding scheme, receiver 1 can decode W\. Our aim 
is to enhance receiver 1 with enough information so that 
it can decode W2 and W3 as well (see Figure |4). Then 
the capacity region of the multiple access channel(MAC) 
formed by the three transmitters and the (enhanced) 



receiver 1 forms an outerbound for the capacity region of 
the interference channel. The improvements to receiver 
1 are described in the following steps 

1) To help receiver 1 decode W<z : Let a genie provide 
receiver 1 with a S\ = a\X\ + 0,2X2 + a 3 X 3 + Z\ 
where Z\ is an AWGN term independent of Xi, i — 
1,2,3. Note that this side information effectively 
acts as an additional antenna at receiver 1. The 
noise term Z\ can possibly be correlated with other 
noise variables Zi, i — 1,2, 3. Now, receiver 1 can 
linearly combine its received signal with its side 
information to form U\ — aY\ + [3Si to form 
another (noisy) linear combination of the codewords 
Xi,i — 1,2,3. a and can be chosen such that 
the co-efficients of X\ and X2 in U\ satisfy the 
conditions of Theorem Q] Note that if these channel 
co-efficients already satisfy the condition of Q] then 
side information of S\ is not needed. Now, the proof 
of Theorem [T] implies that by sufficiently reducing 
the noise at receiver 1, we can ensure that receiver 
1 decodes W2 as well. Thus, with the aid of a genie 
and possibly reducing the noise, we have ensured 
that receiver 1 can decode W2. Note that neither 
the genie information, nor the reduction of noise 
reduce the capacity of this channel and therefore 
do not affect the outerbound argument. 

2) To help receiver 1 decode W3 : Receiver 1, en- 
hanced as described in the previous step, can now 
decode W\ and W2. We can now choose a, /3, 7 
such that 



Vi = aX 1 + /3X 2 + T^i 

= hz^Xi + \13.2X2 + h 3i3 X 3 



Note that receiver 1 can form V\. We use Y 1 and 
Z x above rather than Y\ and Z\ since the previous 
step involves reducing the noise at receiver 1. 
Statistically, V\ differs from Y3 only in the variance 
of the noise term. Therefore, by further reducing the 
noise if required, receiver 1 can also decode W3. As 
in the previous step, it is important to note that the 
reduction of noise does not affect the outerbound 
argument 

Steps 1 and 2 above imply that the capacity region 
of the 3 user Gaussian interference channel is outer- 
bounded by the capacity region of the single-input- 
multiple-output (SIMO) Gaussian MAC which receiver 
Si on one antenna and a reduced-noise version of Y\ 
on the other. This class of bounds can be optimized 
over cti,i = 1,2,3 and the statistics of Z\. Further, 
similar outerbounds can be found by enhancing receiver 
2 or receiver 3 rather than receiver 1. Note that, since 
a MAC with two antennas has 2 degrees of freedom, 



this class of outerbounds is loose from the perspective 
of degrees of freedom. Using the Carliel's outerbounds 
on each of the two user channels contained within the 3 
user interference channel obtains a degrees of freedom 
outerbound of 3/2 (See [12], [18]). We now provide 2 
examples of this class of outerbounds. 

Example 1: Here, we consider the interference channel 
formed on the first carrier of the parallel Gaussian 
interference channel described in Equations (0)-(l7]i in 
the previous section. In this channel, h. L ,j — l,i ^ 
G {1,2,3}. Also hu = h 22 = l,h 33 = -1. With 
AWGN power at each receiver normalized to unity, the 
total transmit power at all the transmitters is defined as 
SNR. Consider any achievable coding scheme. Note that 
this channel already satisfies the conditions of Theorem 
Q] Therefore, we do not need the aid of a genie. In 
fact, both receiver 1 and receiver 2 receive signals of 
the form X x + X 2 + X 3 + Z where Z is an AWGN 
term of unit variance. Therefore, any message that can 
be decoded at receiver 2 can also be decoded at receiver 
1 (and vice-versa). Receiver 1 can hence decode W2. 
Furthermore, receiver 1 can compute X\ + X2 — Y\ = 
h 3 ,iXi + h 3a X 2 + h 3t3 X 3 - Z\. Since (— Z\) is a 
AWGN term having the variance as Z 3 , receiver 1 can 
decode W 3 without requiring any noise reduction. Thus, 
the capacity region of this channel is bounded by the 
capacity region of the multiple access channel formed at 
receiver 1. The sum-capacity of this interference channel 
is therefore bounded by 

C s < 1/2 log (1 + SNR) 

It can be easily verified that the sum-capacity of the 
interference channel corresponding to the second carrier 
of the parallel channel described by Equations (H])-© 
can also be bounded as above. 

Example 2: Consider the perfectly symmetric 3 user 
interference channel where hij = IVi = 1,2,3 and 
hij = h > l,Vi ^ j, i, j e {1,2,3}. Also, let the total 
transmit power be equal to SNR. Since the channel does 
not satisfy the conditions of TheoremQ] a genie provides 
receiver 1 with information of Si = a\Xi + (1 — h)X2 + 
X 3 +Zi where Zj is an i.i.d AWGN term correlated with 



Z x such that E 



1. Note that since we 



{z x + z x y 

started with an achievable coding scheme, receiver 1 can 
decode W\ using information from Yy. Receiver 1 can 
subtract the effect of X\ from S\ and Y\ and to obtain 
Si = (1 - h)X 2 + Z x and Y x = hX 2 + hX 3 + Z x . Now 
receiver 1 can now decode X2 from U \ hX\ + Y\ + Si 
since it is of the form hX\ + X 2 + hX 3 + Z 2 where Z 2 is 
a AWGN term with unit variance. Now that receiver 1 is 
aware of X\ and X2, it can add appropriate terms to Y\ 
to form Vi = h(hX 1 + hX 2 + X 3 ) + Z 1 . Since h > 1, Y 3 



is a degraded version of V\ which implies that receiver 
1 can decode W3 as well. Thus, all rates achievable in 
this interference channel, are achievable in the single- 
input-multiple-output (SIMO) multiple access channel 
with 3 single antenna nodes respectively transmitting 
Xi,X 2 ,X 3 and a two-antenna node receiving Y\ along 
the first antenna and S\ along the second. Thus, the 
capacity region of this multiple access channel is an 
outer-bound for the capacity of the interference channel. 
Furthermore, parameters ai and are parameters which 
can be used for optimization. So, for example, we 
can bound the sum-capacity C S (SNR) of the 3 user 
interference channel by 



C S (SNR) < - 



E 



mm 

(ai.Zi) 

{Zi + Z x ) 2 



Cmac(p, o,\,Z\) 



< 1 



Zi ~ jV(0, cr 2 ) 



where 

C , MA c(SNR,ai,Zi) = log 



| Kz +SNR H Ht| 
IKJ 



I A I indicates the detereminant of matrix A, K z indicates 
the covariance matrix corresponding to noise vector 
[Zi Z{\ T and 

1 ft ft 
01 (1 - ft) 

V. Conclusion 



H = 



We constructed a 3 user interference channel with 
constant (i.e., not frequency-selective or time-varying) 
channel coefficients such that it has 1 degree of freedom. 
Furthermore, we provided a mult-carrier extension of 
this channel such that separate coding over each carrier 
can only achieve sum rate log(SNR) + o(log(SNR)) 
per carrier, while the actual capacity is 3/21og(SNR) + 
o(log(SNR)) which can be achieved only through cod- 
ing across carriers. The result implies that, in general, 
independent coding over the various channel states of 
the parallel Gaussian interference channel is not capacity 
optimal. Thus, unlike parallel Gaussian point to point, 
multiple access and broadcast channels, parallel Gaus- 
sian interference channels are, in general, not separable. 
The key is that even though interference alignment 
may not be possible over each carrier, it may still be 
accomplished by coding across carriers. 

An interesting question that remains open is the sep- 
arability of parallel Gaussian interference channels for 
two users. The counterexample provided in this work 
applies to the 3 user scenario and by simple extension 
to K > 3 users. However, since our examples rely 



on interference alignment which is only known to be 
relevant for interference channels with 3 or more users, 
we have not shown that the 2 user parallel Gaussian 
interference channel is inseparable. It is interesting to 
note that the 2 user interference channel is separable 
under strong interference [11]. 

The inseparability of the interference channel may 
have interesting implications, especially for the existence 
of single-letter capacity characterizations for interference 
channels. From a practical perspective, it prompts a 
closer look at the performance of separate encoding 
versus joint coding schemes in parallel Gaussian inter- 
ference channels. 
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